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Imase Processing and Viceo Synthesis : Doat S. 
Zlectronic Videographic Techniques 


by Stephen Beck 


I. Electronic imasing techniques as applied to television 
utilize the inherent plasticity of the medium to expand it 
beyond +2. szrictly photograr sic/realistic, representational 
aspect wales ciargterizes the nistory of television in -general. 
A wide variety of electronic instruments have been constructed 
by engineers, artists, and engineer-artist collaborations in 
Gie-oaae several_years which operate soecifically with TV sets 


as primary display or “canvass. Bach imaging system which hes 


been developed reflects the artistic and technical capabilities 


Se Sts originators, and tends to be utilized according to distin Cty 
different aesthetic theories. In some cases the resultant izeze 

is larzeiy due to the frherent circuit designs of a given SHSt rue. 
Ir other cases, moe instrument is utilized to produce an imace with 

a snecific visual..or psye chological affect, the electronic ascect ter 
more of a means than ean. end to the realisation. 

Regardless of the specific aesthetic usase or particular in- 
struments, some insight nay be obtained by exemining the structural 
differences and similarities between typical video synthesizers 
and image processors, as well as some of the basic circuitry 
which is used in these devices. In every case; the video syntneater 
may be viewed 2s a “tin of the iceberg “of electronic technology & 
visual‘ artSe ° Vest armies of individuels mekte the transistors, 
resistors, = aan amd intzerated circuits whica comorise 


xz 
a synthesising instr ment, when proverly applied under the design 


of visually Snelined electronic artists. 





sl. Categorical distinctions of electronic vidac instruments. 


Just an tne science of biology many classificstions of life- 


yo 


forms exist, there are several Berre of vides eyeeuesiner: In 
cre sense that a synthesizer in seneral is someting woh th com= 
oines parts to form a Wnole entity, just 2ocut ell video instruments 
ccula be classified as such, However, in tefms of structural 
devalis some clarification can be made. I have listed several 
catezories of video imace instruments accordinzs 79 unique qualities 
tieir scrineiple of operation, alongs witn some criteria for 
matine tre distinction, and artists and engineers in the video 


art flela who are usins these methods. 


1. Oanera imace vrocessor types. These tyses include such 


ARS ; ; 
technisues as colorigz on rhica add chrominancé signal to black 
i , 


_, and white ( mono chrome ) signal from IV cazera;: keyers and 
Quentszers wnich severate value levels in 2 scene and allow 
other rrocesses to take rvlace in ie eéehe- aca synthetic color, 
place another image in certain places of the original, obtain 
matte sifects; modifiers which dol®t alter the geometry of the 
imase tut rather whies affect 1ts grey scalg¢ such as polarity 
inversicn, or which generete and edge around elements of the 
image, or which mix by superinvosttion. several. image; sources, 
Some systems whitch are essentially of the image processor type 


described inblude those >uikt by: Paik/Abe, Siesle (CVS ), 


Templeton, Sandeen, Hearn, Vasulkag, and others. Ege, 

ee Direct Video synthesizer types. These tyres are in principle 
onceived to operate without the use of any camera image, though 

some of them can also perforz the processing operations described 

above. Sasically, a complete TV signal is formed from electronic 


generators which comrrise the Synthesizer circuits, which include 





clruitry such as color genergtors which sroduce chromincance 





Signals accordines to either IeQ methods, Hue-Saturation methogs, 


or Red-Green=-Blue metnods; form venerators whieh es tabiisn the 


=e 





necessary pulse vibrations to produce shapes, plenes, lines, 

or points and to mave tnem in various ways by use of nection 
modulators with either simsle electronic wavés sucn as ramps, 
Sines, or triangles, or mere com -lex curves, or even with audio 


frequency sound sisnalss; texture amvolifiers whien alow fer 





color manipulagion to achieve shadine, GC iarascurd,. "“2irbrvs:” , 
or granulated effects, roughly could be thought of -a$ electronic 
brush effects. Instruments using the Direct Video process 

include those by Beck ( Direet Video Synthesizer ), Siesle ( EYS 


Dupouy ( Movicolor ), EMS ( Spectron ), and cthers. 


3. Scan modulation/ Re-scan types. These types rely on the 
principle of a TV camera viewing an oscilloscope or television 
screen which displays the in ge from another TV camera. Tue 
image on the screen can then be manivulated geometrically 

( stretched, squeezed, rotated, reflected, etc. ) by means of 
deflection modulation, either magnetically or electronically, 
The second TV camera then transforms this imase into one bearing 
a proper TV scan relations:in, and may then be colorized or 
processed by tecnniocues outlined in section 1. These systems 
can also be ised without an input camera where the imase then 
consists only of the manirulation of the raster, producing 


Lissajous type images. “ystems using this method include those 


by Harrison ( Computer Image ), Paik/Abe, Rutt/Stra, and others. 
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4, Non- VIR recordable.types. Tuese types are included 

for completeness and encompass taucse video displays Wooten 

do not actually produce a standard Ty Signal waveform and 
can hence only be utilized on one set wnicsh 1s specially pré= 
cared, and cannot be directly recorded on mannetic video tave. 
Most are based primarily upon magnetic distortion of tne 
nornal TV scan vatter, or else they utilize a color picture 
tune as if it were an oscilloscene screen. Such individuals 
| +AMPELLI WI 
as Paix, Tadlock ( Arexetron ), and Hearn ( Vidiun have 


utilized these teciniaves in their video sculptures - 


I have not included in this categorization the studio switcner 
and special effects generator to be found in most teleproduction 
studios, which include processing and wipe generation, or the 
emerging video game box which is in principle a direct video 
signal generator of very ssecific configuration. Nor nave I 


alluded to video feedback techniques, which all systems are 


cavable of sustaining in one of its various forms. 


In every case the individual approach to video instruments 
encomvasses a wide variety of circuit designs and processes. 
Some require cameras, others do not; some utilize a LOOP s:,; 
of voltage icontrol waich permits color changes, image size, 
or movement ‘rate, for examcles, to be changed by some otner 


circuit, in addition to being changed by an operator, This 


factor indroduces an interesting dilemma into the realm of 


electronic images: how much is the image a product of the 


instrument rather than of the instrumentalist? 


: 





t yideo syntnesizer can be set to conditicns wniicn 
generate image .fter image for hours wpen “wourse pernaos 
Intersestins, pernaps not= denends upon the Lewerle But in 
tiis ezse the images have their comzsosition {r tne chreuit 
desien and programming of the snstrument. Or the image may 
be altered and snaped tempor rally vy someone playing tne video 


syntnesizer, $n which case tne image have tretr composition 


in the mental image of the slsyer, interacting with tae circuit 


One can concéive of a synthesizer as a generative device 
wiick forms the resultant picture by a process of assemblage 
of elisetronic vulsation, or one can conceive cf it as a filtration 
device . in whica, due to the oroper selection of numerous 
electreniec conditions, 2 given image out of tze infinity of 
possitje images results eas a picture. Giordcne Brumo in his 
tnesis De Immerse, Innumerabilius et Infigurapilious postulates 
an infinite number of universes which are perceived by 2 selective 
process .- to form a reality distinetly unique to 
the viewer. Trus it 4s that a video synthesizer and Marconi 
Mefkx VY eclor studio camera reveal very different images@- each 
ig filtering according to very 4i:fferent criteria=- neitner one 
mofe oz less va}id, just aifferent. 

‘nen visual literacy hes advanced sufficiently, many will 
no longer cgnsider the synthesized aes as a by-product of 
television sient: but as a visual reality of its own, 


distinct from the terms of a re vresentational, photographic 


image, an image whicn 1s more glyphic than Literale 





III. Two examples of videc synthesizer circuit structures. 
In order to Jllustrate in more detaii sone typical electronic 


~~ 
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techniques utilized in viceo synthesizer and imaze processed 
circuits I shall mention te comparator oireuit and colorizins 
technniquese 

The commarator is a very ceneral circuit used in keyer 


quantizérs, wibe generators, and form generavorse It is sytoliz 22 


There are two inputs and one sues The inpyts can be 
continucus voltages from, say, a scale of 0-10, The output 
however is allowed only two conditions: ON or OFF, The appropri22 
condition is determined by comparing the values of the tvc inputs. 
If the + input vaiue is greater tnan tne © inzut value tue 

outcut is ON; If the + inrut is the same as or less than the 

~ inrut the paeewieds CFP, <A typical circuit used for els 
function is the arte intesrated circuit, about the size cf 2 
dime. 


“Then the continuous voltage to one inrut comes from a 


+ 


monochrom me TV canera the value O represents any black areas in 
the image, while the value 10 revresents the brightest white 
areas in the ‘picture, with value 5 revresenting an area of 
medium grey. Imagine the image to be a white cross inside 


a grey square surrounded by a blacx backround. the image 


could be devicted schematically as 


09000000 
00555500 
00599500 
0c999900 
oo599500 
09555500 





value source, callec the +-rashold, then the resultant circuit 





45 a simole keyer. The cuvrut will be OFF whenerer the yieture 
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element is less tran the tnreshold and will be CN when 
picture element 4s more then the thresnold. 

For example, tne wiite cross could be colorized by setting 
the taresholec to say value 7 and connecting thie output of Tae 
comparatof to 2 colorizor aztivate circuit. Cnly wnere the 
vieture value exceeds value 7 will the colcr be turned cn , 
in the region occunied dy T2122 CressSe If ancther compararvc> 
were introduced with its +:reshold set to value 4 then the 
output would be Om in the region occupied by tse zrey bOx. enc 
the white cross, and it could be used to ecntrol 2a second 
colorizor producing a colored square, whien mignt be combines 
with the colorized crosse Tf the two incuts to comparatcr 2 
were exchanged, then tne coor sould be inserted into tis areca 
surrounding the grey Square e 

Vlearly this examcle cen “e extended to man channels, 5. OF 

even 16 not being uncommen, 2nd forms the basis for quantizing 
colorizors and multivle level xeyers used by some video artists. 
Bear in mind that the scanning process traverses each line of 
picture eldments in some 52 millionths of a second, with esck 
element being occupied for only 250 nano seconds ( billianths 
of a second ) “so that the comparison must be verformed very fast. 
The u710 can make a comparison jn less than 20 nanoseconds. But 
at this high speed, and when the victure and trresnold levels are 
almost eaual ( within a few +hougandths of a volt ) the outout 
often is undecisive, oscillztings back and forth for a time, pro- 


ducing the speculates or teoun" edge characteristic of keying. 





Colorizing. In televisicn color three tyves of pnos:hors 


are applied to tne inside surface of the picture tube Waren 


ie 


eacn emit a differing color light when excited by electrons 
scanning over them. The taree colors are red, green, and blue, 


ke 


and are applied in either triadic clusters of tiny dots, or in 


very thin strips, se that 4% normal viewing aisvances the 


individual phosphors are not discernable as sucn, but tend to 
fuse their colors accordins %o the suc; 
vision. Each of the primary colors can be varied in intensity 
fron zero to 100% by modulating tne Sntensity of the electron 
streams exciting trem. n thig manner, polycnromatic reproducticn 
is achieved by controlling tne admixture of taree orimary colors. 
Since the color process is additive and involves the mixture 
Sf emisted light,all three colors wnen excited in equal arcunts 
produce the sensation of waite or grey yaluese “nen just ta 
red and the green colors are stimulated a yellow color is SEnsed, 
or when red and blues sare excited, vpurples resulte 

The thrée properties eof ecclor include hue= wnat Le Ue 
wavelength of the color ( i.e. yellow as opposed to green oF blue ) 
saturation- how intense or vivid 4s the hue; and brightness or 
value=} how much is the color diluted or made pastel by the acalcic 
of white or gey. Any video colorizer must determine each of 
the three properties. In black and white television ( more 
properly known as moncnrome ) the picture is composed entirely 
of various intensities of light of a bluish-wnite nature. This 
signal is known in television terminology as tne luminance signal. 
It conveys information of values. With color television an 


additional information beizring signal is used to convey the 


hue and saturation information, called the ehnrominance signal 


Or cnromae 














This cnroninance signal is sresent +4 the fern of 2 color 


- we wet te 


subcarrier wiicn vibrates at 3,579,549 cycles ver seconde 


Its intensity or apnlitude is 


uretion of the color, and its phase 


the hue of the color. This teenniques of ohas> modulation 


requires tne presence of a pilot or reference signal to supply 


the phase angle reference, Known 4&5 the color curste 
In essence, the color spectrum may be visualized aS 0Ce 


cupying a circular distribution. The center ef tne circle 


represents. no saturation,wnile any distance butward from the 


cant 


center represent progr essively more saturated cclors with the 


direction representing tne hue of the colcr. =n fact there are 


actually two elements of tne color subcarrier “hich can be con- 


trolled to vroduce synthetic color; the I ané : components, 


standin: for inphase anc queadraturee 


Lorizérs operate on the hueesaturation wri net ple 
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with one contrcl affecting the phase of the eclor subcarrier 
thus determining red, yelllww; green, cyan, biue, or magenta 
hues % while tue other control affects the amplitude of the sub= 
carrier determining the vividness or saturation of the desired 
hue, an additional} control may be used to S$nzroduce a luminance 
value, or +he ‘subcarrier can be added electrozically to an 
existing monochrome signal derived from a camera. 

Another-type or colorizé? operates by modulating the intensity 
of the I and Q subcarrier comnonents. The cozmoined effect of 
two indevendent modulations generates both nue and saturation 


Snfornztion, witn the twe variables both beings affected simule- 


taneouzly.e Thus to change the vividness of a given hue both 


contrcls ust be changed together. 


A third tyve of colorizer circuit is the Red-Green-£iue 
encoding method. Three controls determine the saturation 
levels of red, green,2and blue primaries, wniten then mix 
4n the encoder to produce luzinance.and chromanance signals 
of the standard video Signel. Beisdes operating ina grapaic 
mode tais type of cclorizer is readily adaptable to other 
TV systems in use vy subs S4ution of encoding circuitry. The 
I/Q and Hue/Saturat Son metheés nermally recuire different 
tecnniaues for eac: type of television system used. 

fany colorizers are li~iced to full screen color or 
quantized color type of operation. This allows for basically 
nard edge colore In the Bec Direct Video syntnesizer I have 
been varticularly interested in surmounting this limitation 


rt 


and achieving 2 full range of color contouring. 


Iv. Video synthesis end cexntuter grachics. In the strict 
sense of the word a digital computer 4s but a large collection 
of electronic switches arranged to operate on binary bits 

of information. As such, most video synthesizers do not 
qualify as computers; altncuzn the analog computer, with oDd- 
QamDS, differentiators, intesrators, and amplifiers more closely 
resembles the structure of video synthesizers. Oomputer 
graphics gBeneraney has been done with oscilloscope displays 
under sonia. control, tiouza some newer systems go zenerate 


ay directly. We can expect 
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{mages on color elevisior 
to see the use of digital cexputers in the control of video 
- synthesizers via means suc 45 digital to analog converters. 
naar When one compares. the bandwidth of video imases ( 4,200,900 


cycles per second ) with comruter processing speeds ( 500,000 


bits per second typically ) or with audio signals ( 20,000 





cycles ver second ) the gap between computer cutput speeds 
Se and tne necessary information rates to senerats a moving 
video image become apoarent. 

Iv terms of circuit devices most video syntnesizers and 
{mace processors utilize discrete transistors and some types of 
integrated microcircuits. We can expect to see tue emergence 
in two or three years of video integrated circuits designed 
specifically for the imaging functions of television displaye 

Video synthesizers consume electrical power of from 50 watts 
to several hundred wattse far less than even 2 single spot- 
Licht utilized by the dozen $n standard camera studios. They 
alse reaulire far fewer personnel to operate then comvared to 
standard televroduction.:. | ‘ | Both of these factors 
make video synthesized television images anpealing from an 


economical persvectivesc 


VY. The appearance of electronic {maging instruments such as 
the videc synthesizer and image processors ushers in a new 
lansuage of the screen; nonere presentational and devarting 
from the conventional television image, these methods will 
stimulate the awarenes 3 of new images in the culture. Any 
growth of the video synthesized image will be contingent 

on the ability of video artists to become proficient in 
techniques of. composing and vresenting synthesized imagery. 
The instruments themselves will not perform witnout the 


artistic consciousness of a skilled operator. 


ee Stevhen Becx 


Submitted Ausust 18, 1975 
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ADstreet: Imace Processing and Video Synthesis 

Slectronic Viceographic Techniques 

by Stephen Beck | 
Tnis article démarcates the structural distinctions between 
vericus instruments constructed and used by video artists. 
In aidition two typival circuits, the comparator and colorizors 
are atscussed. The intent is to clarify for the viewer 


the azproaches to electronic video image making presently in 


USC. 


Stephen Zeck holds-a degree in electrical engineering from 

the University of california, “erkeley, and also studied at 
the University of Illinois, Urbana in electronics and electron 
music. He constructed his first direct video synthesizer ( #C 
in 1969, and another synthesizer while affiliated with the 
National center for Experiments in Television, San Francisco. 
His videographic work include many compositions realised with 
the direct video synthesizer on video tape, live performances 


and videofilms. Presently he works from a studio in. Berkeley 
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FIGURE 1: DIRECT VID2O SYNTHESIZER SYST@éM BLOCK DIAGRAM 


